Search results for "Restricted Boltzmann machine"

showing 2 items of 2 documents

Multitasking associative networks.

2012

We introduce a bipartite, diluted and frustrated, network as a sparse restricted Boltzman machine and we show its thermodynamical equivalence to an associative working memory able to retrieve multiple patterns in parallel without falling into spurious states typical of classical neural networks. We focus on systems processing in parallel a finite (up to logarithmic growth in the volume) amount of patterns, mirroring the low-level storage of standard Amit-Gutfreund-Sompolinsky theory. Results obtained trough statistical mechanics, signal-to-noise technique and Monte Carlo simulations are overall in perfect agreement and carry interesting biological insights. Indeed, these associative network…

NeuronsRestricted Boltzmann machineTheoretical computer scienceArtificial neural networkComputer scienceMonte Carlo methodComplex systemGeneral Physics and AstronomyFOS: Physical sciencesStatistical mechanicsDisordered Systems and Neural Networks (cond-mat.dis-nn)Condensed Matter - Disordered Systems and Neural NetworksPhysics and Astronomy (all)Human multitaskingNeural Networks ComputerNerve NetEquivalence (measure theory)Associative propertyPhysical review letters
researchProduct

An implicitly parallel EDA based on restricted boltzmann machines

2014

We present a parallel version of RBM-EDA. RBM-EDA is an Estimation of Distribution Algorithm (EDA) that models dependencies between decision variables using a Restricted Boltzmann Machine (RBM). In contrast to other EDAs, RBM-EDA mainly uses matrix-matrix multiplications for model estimation and sampling. Hence, for implementation, standard libraries for linear algebra can be used. This allows an easy parallelization and leads to a high utilization of parallel architectures. The probabilistic model of the parallel version and the version on a single core are identical. We explore the speedups gained from running RBM-EDA on a Graphics Processing Unit. For problems of bounded difficulty like …

Restricted Boltzmann machineSpeedupEstimation of distribution algorithmArtificial neural networkComputer scienceLinear algebraGraphics processing unitBoltzmann machineParallel computingProceedings of the 2014 Annual Conference on Genetic and Evolutionary Computation
researchProduct